Information processing apparatus, information processing method, program, and information processing system

ABSTRACT

An information processing apparatus according to the present technology includes an information acquisition unit and a signal output unit. The information acquisition unit acquires electronic information. The signal output unit outputs a first haptic signal for presenting haptic feedback with respect to an object, the haptic feedback with respect to the object being set corresponding to the acquired electronic information.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation application of U.S. patentapplication Ser. No. 16/327,101 filed on Feb. 21, 2019, which is a U.S.National Phase of International Patent Application No. PCT/JP2017/023472filed on Jun. 27, 2017, which claims priority benefit of Japanese PatentApplication No. JP 2016-179144 filed in the Japan Patent Office on Sep.14, 2016. Each of the above-referenced applications is herebyincorporated herein by reference in its entirety.

TECHNICAL FIELD

The present technology relates to an information processing apparatus,an information processing method, a program, and an informationprocessing system capable of presenting information to a user.

BACKGROUND ART

In the related art, a haptic (haptic feedback) technology that transfersinformation to a human through human's haptics has been proposed (forexample, see Patent Literature 1).

CITATION LIST Patent Literature

Patent Literature 1: Japanese Patent Application Laid-open No.2011-159280

DISCLOSURE OF INVENTION Technical Problem

Thus, it is demanded to provide a technology that allows a user tointuitively grasp information.

Solution to Problem

The present technology is made in view of the above-mentionedcircumstances, and it is an object of the present technology to providean information processing apparatus, an information processing method, aprogram, and an information processing system that allows a user tointuitively grasp information.

Solution to Problem

In order to achieve the object, an information processing apparatusaccording to an embodiment of the present technology includes aninformation acquisition unit and a signal output unit.

The information acquisition unit acquires electronic information.

The signal output unit outputs a first haptic signal for presentinghaptic feedback with respect to an object, the haptic feedback withrespect to the object being set corresponding to the acquired electronicinformation.

In the information processing apparatus, it becomes possible to replacethe electronic information with the haptic feedback with respect to theobject and to present the haptic feedback with respect to the object.With this configuration, a user can intuitively grasp the informationthrough presented haptic feedback.

The haptic feedback with respect to the object may include hapticfeedback with respect to a container that contains the objectcorresponding to the acquired electronic information.

With this configuration, it becomes possible to intuitively grasp theinformation through haptic feedback corresponding to the objectcontained in the container.

The electronic information may include a type of information and anamount. In this case, the haptic feedback with respect to the object mayinclude haptic feedback that appears when the container that containsthe object corresponding to the type of information of an amountcorresponding to the amount is moved.

With this configuration, it becomes possible to intuitively grasp thepresented type of information and the amount.

The information processing apparatus may further include a motiondetector that detects a motion of the information processing apparatus.In this case, the signal output unit may output the first haptic signalfor presenting the haptic feedback that appears when the container ismoved on the basis of the detected motion of the information processingapparatus.

With this configuration, it becomes possible to present the hapticfeedback that appears when the information processing apparatus is movedconsidering as the container and to intuitively grasp the information.

The electronic information may include a remaining battery charge. Inthis case, the haptic feedback with respect to the object may includehaptic feedback that appears when the container that contains liquid ofan amount corresponding to the remaining battery charge is moved.

With this configuration, it becomes possible to intuitively grasp theremaining battery charge.

The electronic information may include an electronic money balance. Inthis case, the haptic feedback with respect to the object may includehaptic feedback that appears when the container that contains coins ofan amount corresponding to the electronic money balance is moved.

With this configuration, it becomes possible to intuitively grasp theelectronic money balance.

The signal output unit may output, as the first haptic information, adrive signal for driving a haptic feedback presentation unit thatpresents the haptic feedback with respect to the object by a vibration.

By the vibration, it is possible to easily present the replaced hapticfeedback with respect to the object.

The information acquisition unit may acquire the electronic informationin a case where a predetermined motion of the information processingapparatus is detected.

With this configuration, by moving the information processing apparatusby the user, it becomes possible to execute presentation of theinformation and to easily grasp the information.

The information processing apparatus may further include an informationselection unit that selects a type of the electronic informationacquired by the information acquisition unit on the basis of thedetected motion of the information processing apparatus.

With this configuration, by moving the information processing apparatusby the user, it becomes possible to select the information desired to begrasped.

The signal output unit may output a second haptic signal for presentinghaptic feedback corresponding to the type of the electronic informationselected by the information selection unit.

With this configuration, the user can intuitively grasp the informationto be presented through the haptic feedback.

An information processing method according to an embodiment of thepresent technology is executed by a computer system and includesacquiring electronic information.

A first haptic signal for presenting haptic feedback with respect to anobject is outputted. The haptic feedback with respect to the object isset corresponding to the acquired electronic information.

A program according to an embodiment of the present technology causes acomputer system to execute steps of: acquiring electronic information,and outputting a first haptic signal for presenting haptic feedback withrespect to an object, the haptic feedback with respect to the objectbeing set corresponding to the acquired electronic information.

An information processing system according to an embodiment of thepresent technology includes a first information processing apparatus anda second information processing apparatus.

The first information processing apparatus acquires electronicinformation.

The second information processing apparatus is capable of communicatingwith the first information processing apparatus and outputs a firsthaptic signal for presenting haptic feedback with respect to an object,the haptic feedback with respect to the object being set correspondingto the electronic information acquired by the first informationprocessing apparatus.

Advantageous Effects of Invention

As described above, the present technology allows a user to intuitivelygrasp information. It should be noted that the effects described hereare not necessarily limitative and may be any of effects described inthe present disclosure.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a view showing an appearance of an information processingapparatus according to a first embodiment of the present technology.

FIG. 2 is a block diagram showing a configuration example of hardware ofthe information processing apparatus.

FIG. 3 is a diagram showing an electrical configuration example of avibration generator.

FIG. 4 is a block diagram showing a functional configuration example ofthe information processing apparatus.

FIG. 5 is a flowchart showing a process flow of the informationprocessing apparatus.

FIGS. 6A and 6B are views describing haptic feedback presentedcorresponding to a remaining battery charge and an electronic moneybalance.

FIG. 7 is a table schematically showing a relationship between differentcombinations of motions of the information processing apparatus andtypes of information to be presented in a second embodiment.

FIG. 8 is a block diagram showing a functional configuration example ofthe information processing apparatus.

FIG. 9 is a flowchart showing a process flow of the informationprocessing apparatus.

FIG. 10 is a diagram showing an electrical configuration for generatinga waveform by a waveform determination unit in a third embodiment.

FIG. 11 is a diagram showing a functional configuration example of aninformation processing system in a fourth embodiment.

FIG. 12 is a diagram showing a functional configuration example of aninformation processing system in a fifth embodiment.

MODE(S) FOR CARRYING OUT THE INVENTION

Hereinafter, embodiments of the present disclosure will be describedwith reference to the drawings.

First Embodiment [Configuration of Information Processing Apparatus]

FIG. 1 is a view showing an appearance of an information processingapparatus according to a first embodiment of the present technology.FIG. 2 is a block diagram showing a configuration example of hardware ofthe information processing apparatus.

The information processing apparatus 1 is typically a hand-held mobileinformation terminal, e.g., a smartphone that is assumed to be grippedwith one hand. In addition, a tablet type mobile information terminallarger than the smartphone, a wearable mobile information terminal,e.g., a smartwatch, or the like may be used. Furthermore, the presenttechnology is applicable to any computer.

As shown in FIG. 1, the information processing apparatus 1 includes ahousing 2 and a touch panel 3. For example, a user operates the touchpanel 3 while gripping the housing 2. Also, the user can lift theinformation processing apparatus 1 in the direction including a verticalcomponent (Z direction) or can shake the information processingapparatus 1 in the direction including a horizontal component (Xdirection) while the user grips the housing 2. As a matter of course,other motions are also possible.

As shown in FIG. 2, the information processing apparatus 1 includes acontroller 11, a display unit 12 connected to the controller 11 via abus 10, a communication controller 13, a sensor unit 14, an operationunit 15, a memory unit 16, and a vibration generator 17. These arehoused in the housing 2.

The controller 11 includes a CPU (Central Processing Unit) and the like.The CPU (Central Processing Unit) of the controller 11 loads a programinto a RAM (Random Access Memory) and executes the program. The programis stored in a ROM (Read Only Memory) that is an example of acomputer-readable non-transitory storage medium.

The memory unit 16 includes large capacity storage devices such as theROM (Read Only Memory), the RAM, and an HDD (Hard Disk Drive). The ROMfixedly stores the program or data executed by the controller 11. Theprogram stored in the ROM is loaded into the RAM.

The memory unit 16 stores a variety of information for executing aninformation presentation method that is the information processingmethod according to the present technology. For example, the memory unit16 stores information of “haptic feedback with respect to an object” setcorresponding to information that is presented to a user. The “hapticfeedback with respect to the object” is haptic feedback that is assumedin a case where a user comes in contact with an object in the realworld, a user moves an object, or the like. The information forpresenting the haptic feedback is stored.

In this embodiment, by vibrating at least a part of the housing 2 and/orthe touch panel 3 (contact object) with the vibration generator 17, thehaptic feedback is presented to the user. By controlling a frequency,amplitude (intensity), or the like of a vibration to be generated asappropriate, it is possible to reproduce and present a variety of thehaptic feedback with respect to the object. The information of the“haptic feedback with respect to the object” includes waveforminformation including the frequency or the amplitude (intensity) of thevibration and information about a waveform change, or the like.

The display unit 12 includes an LCD (Liquid Crystal Display), an organicEL (Electroluminescence) display, or the like. The display unit 12performs arithmetic processing on the basis of the information receivedfrom the controller 11 and displays a generated image signal on ascreen.

The operation unit 15 includes the touch panel 3 superimposed with thedisplay unit 12, a variety of physical switches, and the like. Theoperation unit 15 detects a user's operation (tapping operation of touchpanel 3, etc.) and outputs to the controller 11.

The communication controller 13 is an interface for connecting to anetwork N, e.g., the Internet. For example, a wireless LAN module, e.g.,WiFi is used. Note that the communication controller 13 may include acommunication module for short-range wireless communication, e.g., theBluetooth (registered trademark).

The sensor unit 14 includes an acceleration sensor, a gyro sensor, and amicrophone, and one or more amplifiers. The acceleration sensor detectsa direction of movement and a speed of the information processingapparatus 1. The gyro sensor detects an angle (attitude), an angularvelocity, and an angular acceleration of the information processingapparatus 1. The microphone detects a vibration of the informationprocessing apparatus 1. The amplifier amplifies the information acquiredby the acceleration sensor, the gyro sensor, and the microphone andoutputs to the controller 11. Other devices may be used.

FIG. 3 is a diagram showing an electrical configuration example of thevibration generator according to this embodiment. The vibrationgenerator 17 includes a power amplifier, a high-voltage amplifier, apiezoelectric actuator, and the Force reactor (registered trademark).The power amplifier amplifies a drive signal inputted from a signalsupply unit 105 (see FIG. 4) and outputs to the high-voltage amplifierand the Force reactor.

The high-voltage amplifier amplifies the drive signal inputted from thepower amplifier and outputs to the piezoelectric actuator. Thepiezoelectric actuator and the Force reactor convert inputted electricenergy to mechanical energy and generate the vibration. Thus, it will bepossible to vibrate the housing 2 and the like and to present the hapticfeedback corresponding to the information to be presented. Note that inorder to freely vibrate a variety of components of the informationprocessing apparatus 1 with a variety of waveforms, the piezoelectricactuators and the Force reactors may be arranged in a plurality ofpositions.

The configuration of the vibration generator 17 is not limited and maybe freely designed. For example, as the vibration generator 17, a hapticpresentation device disclosed in WO/2015/151380 can be used. Otheractuators having any configuration may be used. Note that the vibrationgenerator 17 corresponds to a haptic feedback presentation unit in thisembodiment.

FIG. 4 is a block diagram showing a functional configuration example ofthe information processing apparatus.

The controller 11 of the information processing apparatus 1 functions asa motion detector 101, an information selection unit 102, an informationacquisition unit 103, a waveform determination unit 104, and the signalsupply unit 105 by loading a program stored in the ROM that is anexample of a computer-readable non-transitory storage medium into theRAM and executing the program.

The motion detector 101 detects a motion of the information processingapparatus 1 on the basis of a detection result of the sensor unit 14.

The information selection unit 102 selects a type of information topresent on the basis of the motion of the information processingapparatus 1. In other words, a type of electronic information acquiredby the information acquisition unit 103 is selected.

The information acquisition unit 103 acquires the electronic informationto present.

The waveform determination unit 104 determines a waveform of thevibration for presenting the “haptic feedback with respect to theobject” set corresponding to the electronic information.

The signal supply unit 105 supplies the vibration generator 17 with adrive signal for vibrating the housing 2 or the like with the waveformdetermined by the waveform determination unit 104. The signal supplyunit 105 corresponds to a signal output unit in this embodiment. Thesupplied drive signal corresponds to a first haptic signal forpresenting the “haptic feedback with respect to the object”.

[Process flow of information processing apparatus] FIG. 5 is a flowchartshowing a process flow of the information processing apparatus.

The motion detector 101 monitors the motion of the informationprocessing apparatus 1 on the basis of the direction of movement and thespeed of the information processing apparatus 1 detected by at least theacceleration sensor of the sensor unit 14 (Step 101). The “motion” ofthe information processing apparatus 1 includes at least the directionof movement and the speed. In a case where the motion of the informationprocessing apparatus 1 is detected (Yes in Step 101), information aboutthe motion of the information processing apparatus 1, i.e., informationabout the direction of movement and the speed is outputted to theinformation selection unit 102.

The information selection unit 102 selects a type of information to bepresented on the basis of the direction of movement and the speed. Inthis embodiment, the type of information to be presented is selected inresponse to different motions of the information processing apparatus 1.

In the example shown in FIG. 5, in a case where a movement distance AZof the information processing apparatus 1 in a direction including avertical component (Z direction of FIG. 1) is greater than apredetermined threshold value (YES in Step S102), a remaining batterycharge is selected as the type of information to be presented. Note thatthe “movement distance in a direction including a vertical component isgreater than a predetermined threshold value” means that the user liftsthe information processing apparatus 1.

In a case where the movement distance ΔZ is equal to or less of thepredetermined threshold value (NO in Step S102), i.e., in a case wherethe information processing apparatus 1 is not lifted, the processproceeds to Step 103. Then, it is determined whether or not a movementdistance ΔX of the information processing apparatus 1 in a directionincluding a horizontal component (X direction of FIG. 1) is greater thana predetermined threshold value (Step 103). The “movement distance in adirection including a horizontal component is greater than apredetermined threshold value” means that the user shakes theinformation processing apparatus 1.

In a case where the movement distance ΔX is equal to or more than thepredetermined threshold value (YES in Step S103), i.e., in a case wherethe information processing apparatus 1 is shaken, an electronic moneybalance is selected as the type of information to be presented. Theinformation selection unit 102 notifies the information acquisition unit103 of the type of information to be presented (remaining battery chargeor electronic money balance).

The information acquisition unit 103 acquires electronic information onthe basis of a notification from the information selection unit 102. Ina case where the remaining battery charge is notified (YES in StepS102), the information acquisition unit 103 reads out the electronicinformation showing the remaining battery charge at present (whatpercentage, %) from the memory unit 16 (Step S104). In a case where theelectronic money balance is notified (YES in Step S103), the informationacquisition unit 103 reads out the electronic information showing theelectronic money balance at present (how many yen) from the memory unit16 (Step S105). The read-out information (remaining battery charge orelectronic money balance) is outputted to the waveform determinationunit 104.

The waveform determination unit 104 acquires the electronic information(remaining battery charge or electronic money balance) from theinformation acquisition unit 103. The waveform determination unit 104determines the waveform for presenting the “haptic feedback with respectto the object” set corresponding to every electronic information (StepS106, S107). Specifically, the waveform information stored correspondingto the remaining battery charge or the electronic money balance is readout from the memory unit 16.

FIGS. 6A and 6B are views describing the haptic feedback presentedcorresponding to the remaining battery charge and the electronic moneybalance. The electronic information (remaining battery charge orelectronic money balance) cannot be touched by a human. It is difficultto intuitively and recognizably present to the user the electronicinformation that cannot be touched by a human, in particular theinformation showing an amount, for example, by a haptic manner, throughthe haptic feedback. In this embodiment, the electronic information thatcannot be touched by a human is virtually replaced with the hapticfeedback with respect to a real object. The “haptic feedback withrespect to the object” to be replaced may be an object to be assumedthat is often touched by the user on a daily basis.

In this embodiment, the haptic feedback with respect to a container thatcontains the object corresponding to the type of information included inthe electronic information by an amount corresponding to the amountincluded in the electronic information is used as the “haptic feedbackwith respect to the object”. The haptic feedback that is assumed toappear when the container is moved is presented by a vibration.

As shown in FIG. 6A, the “haptic feedback with respect to the object”corresponding to the remaining battery charge is presented as the hapticfeedback that appears when a container 30 that contains liquid 31 of anamount corresponding to the remaining battery charge is moved. As thecontainer 30 that contains the liquid 31, a plastic bottle that containswater or the like is assumed, for example, but it is not limitedthereto.

Everyone has an experience that in a case where the container 30 thatcontains the liquid 31 is moved by a hand, a shake of the liquid 31 inthe container 30 is felt along with the motion of the hand. In addition,everyone has an experience that in a case where the liquid in thecontainer 30 is shaken, the haptic feedback that appears when the liquid31 attacks an inner wall of the container 30 is changed depending on theamount of the liquid 31, i.e., a large amount or a small amount.

In other words, even if a human does not view the liquid 31 in thecontainer 30, the human can intuitively understand an analog amount ofthe liquid 31 in the container 30 by holding and moving the container 30by a hand and feeling an analog vibration as haptically along with thevibration of the liquid 31 in the container 30. The reason is that,after the liquid 31 in the container 30 is shaken, the waveforms of thevibration generated by the liquid 31 impinging on the inner wall of thecontainer 30 are different when the amount of the liquid 31 is small andwhen the amount of the liquid 31 is large.

In this embodiment, the waveform expressing the motions of the liquids31 in the containers 30 when the liquids 31 in the amounts correspondingto the remaining battery charge are placed in the same containers 30 andthe containers 30 are moved in a similar manner is simulated in advance.The “liquids in the amount corresponding to the remaining batterycharge” means that there is a correlation (for example, proportion)between the remaining battery charge and the amount of the liquid 31such that if the remaining battery charge is low, the amount of theliquid 31 is also small, and if the remaining battery charge is high,the amount of the liquid 31 is also large.

The waveform information acquired as a result of the simulation isstored in the memory unit 16 in advance. Specifically, a plurality ofremaining battery charges and a plurality of pieces of waveforminformation acquired as the result of the simulation are correlated witheach other, which are stored in the memory unit 16. The waveformdetermination unit 104 reads out from the memory unit 16 the waveinformation correlated with the remaining battery charge acquired fromthe information acquisition unit 103 (Step S106).

As shown in FIG. 6B, the “haptic feedback with respect to the object”corresponding to the electronic money balance is presented as the hapticfeedback that appears when a container 40 that contains coins 41 of anamount corresponding to the electronic money balance is moved. As thecontainer 40 that contains the coins 41, a piggy bank, a glass bottle orthe like is assumed, for example, but it is not limited thereto.

Everyone has an experience that in a case where the container 40 thatcontains the coins 41 is moved by a hand, the movement of the coins 41in the container 40 is felt along with the motion of the hand. Inaddition, everyone has an experience that in a case where the coins 41in the container 40 are moved, the haptic feedback that appears when thecoins 41 attack an inner wall of the container 40 is changed dependingon the amount of the coins 41, i.e., a large amount or a small amount.

In other words, even if a human does not view the coins 41 in thecontainer 40, the human can intuitively understand an analog amount ofthe coins 41 in the container 40 by holding and moving the container 40by a hand and feeling an analog vibration as haptically along with themovement of the coins 41 in the container 40. The reason is that, afterthe coins 41 in the container 40 are moved, the waveforms of thevibration generated by the coins 41 impinging on the inner wall of thecontainer 40 are different when the amount of the coins 41 is small andwhen the amount of the coins 41 is large.

In this embodiment, the waveform expressing the motions of the coins 41in the containers 40 when the coins 41 in the amounts corresponding tothe electronic money balance are placed in the same containers 40 andthe containers 40 are moved in a similar manner is simulated in advance.The “coins in the amount corresponding to the electronic money balance”means that there is a correlation (for example, proportion) between theelectronic money balance and the amount of the coins 41 such that if theelectronic money balance is low, the amount of the coins 41 (the numberof coins) is also small, and if the electronic money balance is high,the amount of the coins 41 (the number of coins) is also large.

The waveform information acquired as a result of the simulation isstored in the memory unit 16 in advance. Specifically, a plurality ofbalances of electronic money and a plurality of pieces of waveforminformation acquired as the result of the simulation are correlated witheach other, which are stored in the memory unit 16. The waveformdetermination unit 104 reads out from the memory unit 16 the waveinformation correlated with the electronic money balance acquired fromthe information acquisition unit 103 (Step S107).

The waveform determination unit 104 supplies the signal supply unit 105with the waveform information read out from the memory unit 16. Thesignal supply unit 105 acquires the waveform information from thewaveform determination unit 104. The signal supply unit 105 supplies thevibration generator 17 with the drive signal for vibrating the contactobject in this waveform (Step S108, S109).

If the information processing apparatus 1 is neither lifted (NO in StepS102) nor shaken (NO in Step S103) and a power supply is on (YES in StepS110), it stands-by until the motion is detected (NO in Step S101).

As described above, the information processing apparatus 1 according tothis embodiment allows the electronic information that cannot be touchedby a human to be replaced with and present the “haptic feedback withrespect to the object”. For example, through the haptic feedbackcorresponding to the movement of the liquid 31 acquired when theinformation processing apparatus 1 is moved, it becomes possible tointuitively grasp the remaining battery charge. In addition, through thehaptic feedback corresponding to the movement of the coins 41 acquiredwhen the information processing apparatus 1 is moved, it becomespossible to intuitively grasp the electronic money balance.

The electronic information cannot be touched by a human. It is difficultto intuitively and recognizably present the electronic information thatcannot be touched by a human, in particular the information showing anamount, for example, by a haptic manner, through the haptic feedback.According to this embodiment, the electronic information that cannot betouched by a human is virtually replaced with the “haptic feedback withrespect to the object” that can be haptically recognized and is assumedto be often touched by a human on a daily basis.

According to this embodient, the electronic information that cannot betouched by a human (remaining battery charge, electronic money balance)is replaced with the haptic feedback that appears when the object(liquid, coins) is placed in the container and the container is moved.Everyone has an experience that in a case where the container thatcontains the object is moved by a hand, a shake of the object in thecontainer is felt along with the motion of the hand. In addition,everyone has an experience that in a case where the object in thecontainer is shaken, the haptic feedback that appears when the objectattacks an inner wall of the container is changed depending on theamount of the object, i.e., a large amount or a small amount.

In other words, even if a human does not view the object in thecontainer, the human can intuitively understand an analog amount of theobject in the container by holding and moving the container by a handand feeling an analog vibration as haptically along with the vibrationof the object in the container. The reason is that, after the object inthe container is shaken, the waveforms of the vibration generated by theobject impinging on the inner wall of the container 30 are differentwhen the amount of the object is small and when the amount of the objectis large.

In this embodiment, the waveform expressing the motions of the objectsin the containers when the objects in the amounts corresponding to theelectronic information showing an amount are placed in the samecontainers and the containers are moved in a similar manner is simulatedin advance. The “objects in the amount corresponding to the electronicinformation showing an amount” means that there is a correlation (forexample, proportion) between the amount shown by the electronicinformation and the amount of the object such that if the amount shownby the electronic information is small, the amount of the object is alsosmall, and if the amount shown by the electronic information is large,the amount of the object is also large.

Note that the replacement shown in FIGS. 6A and 6B can also be said thatthe electronic information is virtually replaced with the motion of theobject. In other words, it can also be said that the electronicinformation that cannot be touched by a human is virtually replaced withthe motion of the object that can be touched by a human. For example,the remaining battery charge is virtually replaced with the motion ofthe liquid 31 in the container 30 when the liquid 31 is placed in thecontainer 30 and the container 30 is moved. In addition, the electronicmoney balance can be virtually replaced with the motion of the coins 41in the container 40 that appears when the coins 41 are placed in thecontainer 40 and the container 40 is moved. The waveform that expressesthe replaced motion is generated and the housing 2 or the like vibrates.Thus, the user feels an analog vibration as the haptic feedback and canintuitively understand the electronic information (information showingamount).

Furthermore, according to this embodiment, the information selectionunit 102 selects the type of information to be presented in response tothe different motions of the information processing apparatus 1. Morespecifically, the information selection unit 102 selects the remainingbattery charge when a user lifts the information processing apparatus 1and selects the electronic money balance when the user shakes theinformation processing apparatus 1. Thus, the user does not need to viewthe screen for operating the touch panel 3 or the like in order toselect the information to be presented. Accordingly, even if the userhas anxious about eyesight, for example, the type of information to bepresented can be selected with no problem. Also, it can avoid a risk ofwalking while viewing the screen of the smartphone or the like.

Furthermore, the selection of the type of information and thepresentation of the information are completed by the user's action(“shake” or the like) and the haptic feedback. Thus, the user does neverneed to view the screen for operating the touch panel 3 or the like andcan intuitively and momentarily select the type of information andrecognize the information.

Second Embodiment

In the following description, configurations, actions, and the likesimilar to the configurations, the actions, and the like alreadydescribed are denoted by the same or similar reference numerals, andthus detailed description thereof will be hereinafter omitted. Mainly,only different points will be described.

The different point between the first embodiment and a second embodimentis a method of selecting the type of information to be presented by theinformation selection unit 102. In the first embodiment, the informationselection unit 102 selects the type of information to be presented inresponse to the different motions (lift, shake) of the informationprocessing apparatus 1. In contrast, in the second embodiment, theinformation selection unit 102 selects the type of information to bepresented in response to different combinations of the motions (lift,shake, or the like) of the information processing apparatus 1.

FIG. 7 is a table schematically showing a relationship between thedifferent combinations of the motions of the information processingapparatus and the types of information to be presented in the secondembodiment.

The table (library) showing the relationship between the differentcombinations of the motions of the information processing apparatus andthe types of information to be presented is stored in the memory unit 16in advance. The information selection unit 102 refers to the library andselects the type of information to be presented.

FIG. 8 is a block diagram showing a functional configuration example ofthe information processing apparatus. FIG. 9 is a flowchart showing aprocess flow of the information processing apparatus.

The information selection unit 102 acquires the information about themotions of the information processing apparatus 1, i.e., the informationabout the direction of movement and the speed from the motion detector101. The information selection unit 102 determines the types of themotions of the information processing apparatus 1, i.e., any of lift,shake, and lift from a horizontal state (Step S201). The “lift” and the“shake” are determined in the same manner as those in the firstembodiment. The “horizontal state” can be determined on the basis of theinformation acquired from the gyro sensor of the sensor unit 14.

The information selection unit 102 refers the library preliminary storedin the memory unit 16 and selects a preliminary vibration correspondingto the type of the motion determined (Step S202). The “preliminaryvibration” is a vibration correlated with the type of information to bepresented and is defined in the library along with the types of theuser's different motions. In this embodiment, the preliminary vibration“once” is correlated with the remaining battery charge, and thepreliminary vibration “twice” is correlated with the electronic moneybalance. In addition, the preliminary vibration “three times” iscorrelated with a rainfall amount in weather.

The user understands the information defined in the library in advance,and can grasp the types of information to be presented on the basis ofthe number of times of the preliminary vibration. In other words, the“preliminary vibration” will be the haptic feedback for confirming thetype of information to be presented with the user.

Note that, in this embodiment, in a case where the “lift” is determinedas the first action, the preliminary vibration “once” is selected. In acase where the “shake” is determined as the first action, thepreliminary vibration “twice” is selected. In addition, in a case wherethe “lift from a horizontal state” is determined as the first action,the preliminary vibration “three times” is selected. By the number oftimes of the “preliminary vibration”, it also becomes possible todetermine whether or not own motion is inputted properly. In otherwords, it is also possible to allow function the “preliminary vibration”as the haptic feedback for confirming the user with the type of themotion determined by the information selection unit 102.

The information selection unit 102 issues a command to the signal supplyunit 105 such that a drive signal for performing the selectedpreliminary vibration is supplied to the vibration generator 17. Thesignal supply unit 105 supplies the vibration generator 17 with thedrive signal for performing the selected preliminary vibration (StepS203). The vibration generator 17 performs the preliminary vibration onthe basis of the drive signal.

In a case where the information selection unit 102 acquires theinformation about the motion of the information processing apparatus 1from the motion detector 101 within a certain period of time thereafter(YES in Step S204), the information selection unit 102 determines thetype of the motion (Step S205). The information selection unit 102determines the type of the motion as the motion that the user instructsto present the preliminary vibration again (for example, motions otherthan the “shake” such as “hitting” and “rotation”) or as the motion forselecting the information to be presented (in this embodiment “shake”)(Step S206).

In a case where the information selection unit 102 determines that themotion instructs presentation of the preliminary vibration again (YES inStep S206), the information selection unit 102 issues the command to thesignal supply unit 105 such that the drive signal for performing thesame number of times of the preliminary vibration is supplied to thevibration generator 17 (Step S203). On the other hand, in a case wherethe information selection unit 102 determines that the motion is forselecting the information to be presented (“shake”) (NO in Step S206),the information selection unit 102 selects the preliminary actioncorrelated with other information to be presented (Step 202). Forexample, a preliminary action of the number of times obtained by addingone to the previous preliminary action is selected.

Thus, in a case where the user determines that the number of times ofthe preliminary vibrations is not the number of times correlated withthe type of information that the user desires (for example, the userdesires the “electronic money balance” correlated with the preliminaryvibration “twice”, but the preliminary vibration is “once”), it becomespossible to move (shake) the information processing apparatus 1 again toselect the type of information. By moving the information processingapparatus 1 until the number of times of the preliminary actioncorrelated with the type of information that the user desires isrealized, it becomes possible to easily select the information to bepresented.

The information selection unit 102 repeats Steps S201 to S206 anddetermines the type of information to be presented in a case where theinformation about the motion of the information processing apparatus 1is not acquired from the motion detector 101 (NO in Step S204). In otherwords, detection of the motion of the information processing apparatus 1and the preliminary vibration are repeated. The type of informationcorrelated with the number of times of the preliminary vibration finallypresented is determined as the type of information to be presented.Also, as shown in FIG. 7, in this embodiment, the combinations of thedetected motion and the preliminary vibration and the types ofinformation to be presented are defined as follows:

(1) In a case where a first motion is the “lift”, a next motion is afirst preliminary vibration “once”, and there is no next motion, theremaining battery charge is selected.

(2) In a case where the first motion is the “lift”, the next motion isthe first preliminary vibration “once”, a second motion is the “shake”,the next motion is a second preliminary vibration “twice”, and there isno next motion, the electronic money balance is selected.

(3) In a case where the first motion is the “shake”, the next motion isthe first preliminary vibration “twice”, and there is no next motion,the electronic money balance is selected.

(4) In a case where the first motion is the “shake”, the next motion isthe first preliminary vibration “twice”, the next motion is the secondmotion “shake”, the next motion is the second preliminary vibration“three times”, and there is no next motion, the rainfall amount in(weather) is selected.

(5) In a case where the first motion is the “shake”, the next motion isthe first preliminary vibration “twice”, the next motion is the secondmotion “shake”, the next motion is the second preliminary vibration“three times”, the next motion is a third motion “shake”, the nextmotion is a third preliminary vibration “once”, and there is no motion,the remaining battery charge is selected.

(6) In a case where the first motion is the “lift from a horizontalstate”, the next motion is the first preliminary vibration “threetimes”, and there is no motion, the rainfall amount in (weather) isselected.

The information selection unit 102 notifies the information acquisitionunit 103 of the types of information (remaining battery charge,electronic money balance, and rainfall amount in weather) determined byrepeating Steps S201 to S206.

Note that the haptic feedback presented by the preliminary vibrationcorresponds to the haptic feedback corresponding to the selectedelectronic type. In addition, the drive signal outputted to execute thepreliminary vibration corresponds to a second haptic vibration.

The information acquisition unit 103 receives a notification about thetype of information to be presented (remaining battery charge,electronic money balance, and rainfall amount in weather) from theinformation selection unit 102. The information acquisition unit 103acquires the notified type of information (electronic information). In acase where the rainfall amount in weather is notified, the informationacquisition unit 103 acquires the electronic information showing therainfall amount of a predetermined area (present location, targetlocation, or the like) at a predetermined time (current or future) fromthe memory unit 16 or a server device (not shown) through a network N.The information acquisition unit 103 supplies the waveform determinationunit 104 with the acquired information (remaining battery charge,electronic money balance, rainfall amount in weather).

The waveform determination unit 104 acquires the electronic information(remaining battery charge, rainfall amount in weather) from theinformation acquisition unit 103. The waveform determination unit 104reads out the waveform information correlated with the electronicinformation acquired from the information acquisition unit 103 from thememory unit 16. The waveform determination unit 104 supplies the signalsupply unit 105 with the waveform information read out from the memoryunit 16. The signal supply unit 105 acquires the waveform informationfrom the waveform determination unit 104. The signal supply unit 105supplies the vibration generator 17 with the drive signal for vibratingthe contact object with this waveform (Step S207).

For example, the “haptic feedback with respect to the object” that therainfall amount information in weather is virtually replaced may be themotion of liquid in the container that appears when the liquid in theamount corresponding to the rainfall amount is placed in the containerand the container is moved similar to the case of the remaining batterycharge. Alternatively, the haptic feedback that feels as if raindropsfall on a palm in an amount corresponding to the rainfall amount, i.e.,the haptic feedback that feels as if the hand is locally andcontinuously pressed, may be presented.

Thereafter, in a case where the information selection unit 102 acquiresthe information about the motion from the motion detector 101 within acertain period of time and determines that the motion instructs thepresentation again (for example, motions other than the “shake” e.g.,“hit”, “rotate”, or the like) (YES in Step S208), the informationselection unit 102 instructs again the signal supply unit 105 to supplythe vibration generator 17 with the drive signal (Step S207). On theother hand, in a case where the information selection unit 102determines that the information about the motion acquired from themotion detector 101 is the motion that instructs to present another typeof information (for example, “shake”) (YES in Step S208, No in StepS209), another type of information is selected (Step S210). For example,in a case where the remaining battery charge is selected, the electronicmoney balance is selected as another type of information. The contactobject vibrates again and the electronic money balance is presented(Step S207).

According to the second embodiment, the effects similar to thosedescribed in the first embodiment are provided. Moreover, since theinformation selection unit 102 can select the type of electronicinformation in response to the different combinations of the motions ofthe information processing apparatus 1, it also becomes possible toselect a number of the types of information by the combinations ofsimple actions for the user.

Third Embodiment

The different point between the first embodiment and a third embodimentis a method of determining the waveform by the waveform determinationunit 104. In the first embodiment, the waveform determination unit 104reads out the waveform information from the memory unit 16. In contrast,in the third embodiment, the waveform determination unit 104 generatesthe waveform on the basis of the waveform information read out from thememory unit 16 and the motion of the information processing apparatus 1acquired by the motion detector 101.

FIG. 10 is a diagram showing an electrical configuration for generatingthe waveform by the waveform determination unit 104 in the thirdembodiment.

The acceleration sensor (G-sensor) of the sensor unit 14 detects thevibration of the information processing apparatus 1 and outputs adetection signal to the acceleration sensor amplifier. The accelerationsensor amplifier amplifies the detection signal inputted from theacceleration sensor and outputs to the waveform determination unit 104.A microphone (MIC) detects the vibration of the information processingapparatus 1 and outputs the detection signal to a microphone amplifier.The microphone amplifier amplifies the detection signal inputted fromthe microphone and outputs to the waveform determination unit 104.

The waveform determination unit 104 reads out the waveform informationfrom the memory unit 16. The waveform information is for presenting thehaptic feedback acquired by replacing the electronic information withthe “haptic feedback with respect to the object”. On the basis of thewaveform, the waveform determination unit 104 generates a waveform thatfollows the vibration (motion) of the information processing apparatus 1acquired from the sensor unit 14.

The “waveform that follows the vibration (motion)” will be described.With reference to FIGS. 6A and 6B, the description is made byillustrating the motion of the liquid 31 in the container 30 when theliquid 31 that replaces the remaining battery charge information isplaced in the container 30 and the container 30 is moved. In a casewhere the container 30 that contains the liquid 31 is moved by a hand, ashake of the liquid 31 in the container 30 is felt along with the motionof the hand. Everyone has an experience that in a case where the liquidin the container 30 is shaken, the haptic feedback that appears when theliquid 31 attacks an inner wall of the container 30 is different whenthe container 30 is strongly moved and when the container 30 is weaklymoved. The reason is that, after the liquid 31 in the container 30 isshaken, the waveforms of the vibration generated by the liquid 31impinging on the inner wall of the container 30 are different when thecontainer 30 is strongly moved and when the container 30 is weaklymoved.

Thus, in this embodiment, the waveform expressing the motions of theliquids 31 in the containers 30 when the liquids 31 in the amountscorresponding to the remaining battery charge are placed in the samecontainers 30 and the containers 30 are moved is simulated by followingan amount of the motions and directions of the containers 30. In otherwords, moving the information processing apparatus 1 by holding by auser's hand is regarded as moving the container 30 that contains theliquid 31 by the hand. When the user moves the information processingapparatus 1, the waveform is simulated in a real time by following themotions.

Specifically, for example, in a case where the user strongly shakes theinformation processing apparatus 1, a random vibration waveform havinglarge amplitude is generated such that the liquid 31 strongly hits on awall surface of the container 30 and bounces back in many times. Forexample, in a case where the user weakly shakes the informationprocessing apparatus 1, a ripple-like vibration waveform having smallamplitude is generated such that the liquid 31 weakly hits on the wallsurface of the container 30 and immediately converges.

In addition, in order to vibrate a variety of parts of the informationprocessing apparatus 1, one or more piezoelectric actuators and/or oneor more Force reactors shown in FIG. 10 are provided at one or moreappropriate positions. As a result, it realizes the vibration thatfollows a tilt of the information processing apparatus 1. For example,in a case where the user tilts the information processing apparatus 1,the liquid 31 flows in a tilted direction, and it realizes the vibrationsuch that the liquid 31 strongly hits on the wall surface of thecontainer and bounces back at an end.

As described above, the waveform determination unit 104 generates thewaveform that follows the motion of the information processing apparatus1 on the basis of the waveform that appears when the electronicinformation is replaced with the “haptic feedback with respect to theobject”. Thus, according to the third embodiment, the haptic acquired bythe user is closer to the haptic (haptic feedback) acquired from a realobject motion as compared with the first embodiment. Accordingly, theuser feels an analog vibration closer to reality as the haptic feedbackand can more intuitively understand the electronic information(information showing amount).

Fourth Embodiment

In the first embodiment, one information processing apparatus 1 detectsthe motion of the information processing apparatus 1 and vibrates. Incontrast, in a fourth embodiment, there are two information processingapparatuses intercommunicable via a network. In a case where oneinformation processing apparatus detects a motion of own apparatus, theother information processing apparatus vibrates.

FIG. 11 is a diagram showing a functional configuration example of aninformation processing apparatuses in the fourth embodiment.

An information processing system S1 includes a first informationprocessing apparatus 1A and a second information processing apparatus1B. The first information processing apparatus 1A and the secondinformation processing apparatus 1B are intercommunicable via a networkN, e.g., the Internet.

The first information processing apparatus 1A at least includes a sensorunit 14A, a motion detector 101A, an information selection unit 102A, aninformation acquisition unit 103A, and a waveform determination unit104A of a controller 11A.

The second information processing apparatus 1B at least includes asignal supply unit 105B of a controller 11B and a vibration generator17B. The second information processing apparatus 1B having thisconfiguration may not be a mobile information terminal, e.g., asmartphone but be a device mainly having a vibration function.

In the first information processing apparatus 1A, the motion detector101A detects the motion of the first information processing apparatus 1Aon the basis of the direction of movement and the speed of the firstinformation processing apparatus 1A detected at least by theacceleration sensor of the sensor unit 14A. The information selectionunit 102A selects the type of information to be presented in response tothe different motions of the first information processing apparatus 1A.The information acquisition unit 103A acquires electronic information tobe presented. The waveform determination unit 104A determines thewaveform for presenting the “haptic feedback with respect to the object”when the electronic information is virtually replaced with the “hapticfeedback with respect to the object”. The first information processingapparatus 1A supplies the second information processing apparatus 1Bwith the waveform determined by the waveform determination unit 104A viathe network N.

The second information processing apparatus 1B acquires the waveformfrom the first information processing apparatus 1A via the network N.The signal supply unit 105B supplies the vibration generator 17B withthe drive signal for vibrating the contact object (at least part ofhousing and/or touch panel of information processing apparatus 1B) withthe waveform acquired from the first information processing apparatus1A. The vibration generator 17B vibrates on the basis of the inputteddrive signal and makes the contact object to vibrate.

As described above, one first information processing apparatus 1A andone second information processing apparatus 1B are described but are notlimited thereto. The information processing system S1 may include onefirst information processing apparatus 1A and a plurality of secondinformation processing apparatuses 1B. Thus, in a case where one firstinformation processing apparatus 1A detects the motion of own apparatus,the plurality of second information processing apparatuses 1B vibrates.Alternatively, the information processing system S1 may include aplurality of first information processing apparatuses 1A and one secondinformation processing apparatus 1B. Thus, in a case where each of theplurality of first information processing apparatuses 1A respectivelydetects the motions of own apparatuses, one second informationprocessing apparatus 1B vibrates. Alternatively, the informationprocessing system S1 may include the plurality of first informationprocessing apparatuses 1A and the plurality of second informationprocessing apparatuses 1B (any of which is not shown).

Fifth Embodiment

In the fourth embodiment, there are two information processingapparatuses intercommunicable via the network. One informationprocessing apparatus can detect the motion of own apparatus but cannotvibrate, and the other information processing apparatus can vibrate butcannot detect the motion of own apparatus. In contrast, in a fifthembodiment, both the two information processing apparatusesintercommunicable via the network can detect the motions of ownapparatuses and vibrate.

FIG. 12 is a diagram showing a functional configuration example of aninformation processing system in the fifth embodiment.

An information processing system S2 includes a first informationprocessing apparatus 2A and a second information processing apparatus2B. The first information processing apparatus 2A and the secondinformation processing apparatus 2B are intercommunicable via thenetwork N, e.g., the Internet.

Each of the first information processing apparatus 2A and the secondinformation processing apparatus 2B includes the sensor unit 14, themotion detector 101, the information selection unit 102, the informationacquisition unit 103, the waveform determination unit 104, the signalsupply unit 105 of the controller 11, and the vibration generator 17.

In the first information processing apparatus 2A, the motion detector101 detects a motion of the first information processing apparatus 2A onthe basis of the direction of movement and the speed of the firstinformation processing apparatus 2A detected by at least theacceleration sensor of the sensor unit 14. The information selectionunit 102 selects the type of information to be presented in response tothe different motions of the first information processing apparatus 2A.The information acquisition unit 103 acquires the electronic informationto be presented. The waveform determination unit 104 determines thewaveform for presenting the “haptic feedback with respect to the object”when the electronic information is replaced with the “haptic feedbackwith respect to the object”. The first information processing apparatus2A supplies the second information processing apparatus 2B with thewaveform determined by the waveform determination unit 104 via thenetwork N.

The second information processing apparatus 2B acquires the waveformfrom the first information processing apparatus 2A via the network N.The signal supply unit 105 supplies the vibration generator 17 with thedrive signal for vibrating the contact object (at least part of housingand/or touch panel of information processing apparatus 1B) with thewaveform acquired from the first information processing apparatus 2A.The vibration generator 17B vibrates on the basis of the inputted drivesignal and makes the contact object to vibrate.

Modification of Fifth Embodiment

As described above, the two information processing apparatuses 2A and 2Bare described but are not limited thereto. The information processingsystem S2 may include three or more information processing apparatuses(not shown). Thus, in a case where one or the plurality of firstinformation processing apparatuses detect the motions of ownapparatuses, the other or the plurality of information processingapparatuses vibrate.

As described above, the waveform determined by the waveformdetermination unit 104 of the first information processing apparatus 2Ais supplied to the second information processing apparatus 2B.Alternatively, the information acquisition unit 103 of the firstinformation processing apparatus 2A supplies the second informationprocessing apparatus 2B with the electronic information and the waveformdetermination unit 104 of the second information processing apparatus 2Bmay determine the waveform.

Modification

The embodiments according to the present technology are not limited tothe above-described embodiments and may be variously modified.

The electronic money balance or the like is presented by using as atrigger the specific motion (shake) of the information processingapparatus in the first embodiment and by using as a trigger a specificcombination of the motions of the information processing apparatuses inthe second embodiment. Alternatively, for example, the informationprocessing apparatus may have a GPS (Global Positioning System) sensorand may present the electronic money balance or the like by using as atrigger an approach of the information processing apparatus around astation ticket gate.

Alternatively, the electronic money balance or the like may be presentedby using as a trigger the specific motion (shake) of the informationprocessing apparatus around a station ticket gate. Alternatively, theelectronic information may be presented by using a trigger a depressionof a physical button of the information processing apparatus 1.

In each embodiment, the contact object is allowed to vibrate with thewaveform for presenting the “haptic feedback with respect to the object”when the electronic information (information showing an amount;specifically remaining battery charge, electronic money balance, andrainfall amount in weather) is replaced with the “haptic feedback withrespect to the object”. Alternatively, as the electronic information,the following specific examples (1) to (5) may be used and the contactobject may be allowed to vibrate with the waveform for presenting the“haptic feedback with respect to the object” when the electronicinformation in each example is replaced with the “haptic feedback withrespect to the object”. The electronic information may not show anamount.

(1) Time

The information processing apparatus detects an action of, for example,touching the information processing apparatus (as it is not shaken, theinformation processing apparatus may be kept in a pocket, etc.) with theacceleration sensor. The information processing apparatus reads out timeinformation and allows the vibration generator to vibrate with thevibration waveform set in response to the current time.

(2) Home Information

The information processing apparatus detects the current position withina home with a WiFi strength of a home network and detects the motion(shake) of the information processing apparatus with the accelerationsensor. The information processing apparatus notifies the server devicein the home of the detected current position and the motion via a homenetwork. The server device receives and uses the notification as atrigger to read out the electronic information (forgot to lock door,electric power usage state, or the like) from own apparatus or acquirefrom other devices via the home network. The server device determinesthe vibration waveform set in response to the acquired electronicinformation and supplies the vibration waveform to the informationprocessing apparatus via the home network. The information processingapparatus allows the vibration generator to vibrate with the vibrationwaveform acquired from the server device via the home network.

Alternatively, the server device supplies the information processingapparatus with the acquired electronic information via the home network.The information processing apparatus acquires the electronic informationfrom the server device via the home network. The information processingapparatus determines the vibration waveform set in response to theacquired electronic information and allows the vibration generator tovibrate with the determined vibration waveform.

(3) Pet Activities

The acceleration sensor is attached to a pet in the home in advance. Theserver device in the home stores the motion of the pet detected by theacceleration sensor attached to the pet. The information processingapparatus detects the motion (shake) of the information processingapparatus by the acceleration sensor. Once the motion is detected, theinformation processing apparatus notifies the server device in the homevia the home network. Receiving the notification, the server reads outthe electronic information (motion of pet) using the notification as atrigger, determines the vibration waveform set in response to theacquired electronic information, and supplies to the informationprocessing apparatus via the home network. The information processingapparatus allows the vibration generator to vibrate with the vibrationwaveform acquired from the server device via the home network.

Alternatively, the server device supplies the acquired electronicinformation to the information processing apparatus via the homenetwork. The information processing apparatus acquires the electronicinformation from the server device via the home network. The informationprocessing apparatus determines the vibration waveform set in responseto the acquired electronic information and allows the vibrationgenerator to vibrate with the determined vibration waveform.

Alternatively, the server device is not interposed, the firstinformation processing apparatus may be used as a small-sizedinformation processing apparatus (including acceleration sensor)attached to the pet, and the second information processing apparatus maybe used as a mobile information terminal that the user holds in theinformation processing system according to the fourth embodiment.

(4) Partner'S (Other Person'S) Activities

A partner (other person) wears a wearable terminal (including pulsesensor). The user includes the information processing apparatus. Theinformation processing apparatus detects the motion (shake) of theinformation processing apparatus by the acceleration sensor. Theinformation processing apparatus notifies the wearable terminal of thedetected motion via the network. The wearable terminal receives thenotification and supplies the information processing apparatus with theelectronic information (pulse recorded data) via the network. Theinformation processing apparatus acquires the pulse recorded data viathe network. The information processing apparatus determines thevibration waveform set in response to the acquired electronicinformation and allows the vibration generator to vibrate with thedetermined vibration waveform. According to this embodiment, forexample, in a case where a wearable terminal (including pulse sensor) isattached to an aged person and a family who live apart, care workers,medical personals, and the like hold the information processingapparatus, the user of the information processing apparatus can grasp anactivity condition and a health condition of the aged person.

Alternatively, the server device (in the home or in the Internet) may beinterposed. In other words, the electronic information (pulse recordeddata) detected by the wearable terminal is stored in the server deviceand the server device may supply the information processing apparatuswith the electronic information (pulse recorded data) via the network.Alternatively, the server device may determine the vibration waveform onthe basis of the electronic information (pulse recorded data) and supplythe information processing apparatus with the vibration waveform via thenetwork.

(5) Information about Refrigerator Content (Food Stuff Leftovers)

It assumes that the user holds the information processing apparatus(including GPS sensor) and is at the food section or the like. Theinformation processing apparatus detects the current position by the GPSsensor and the motion (shake) of the information processing apparatus isdetected by the acceleration sensor. The information processingapparatus acquires information about a selling section at the detectedcurrent position via the Internet. Once the information processingapparatus acquires a “food section” as the information about the sellingsection, the information processing apparatus notifies the informationprocessing apparatus mounted to a refrigerator in the home of thedetection of the motion via the Internet. The information processingapparatus mounted to the refrigerator measures a weight of contents(food stuff leftovers) in the refrigerator and acquires the electronicinformation (weight of food stuff leftovers). The information processingapparatus mounted to the refrigerator supplies the informationprocessing apparatus held by the user with the acquired electronicinformation (weight of food stuff leftovers) via the Internet. Theinformation processing apparatus held by the user determines thevibration waveform set in response to the acquired electronicinformation and allows the vibration generator to vibrate with thedetermined vibration waveform.

Alternatively, the server device (in the home or in the Internet) may beinterposed. In other words, the electronic information (weight of foodstuff leftovers) detected by the information processing apparatusmounted to the refrigerator may be stored in the server device and theserver device may supply the information processing apparatus held bythe user with the electronic information (weight of food stuffleftovers) via the network. Alternatively, the server device maydetermine the vibration waveform on the basis of the electronicinformation (weight of food stuff leftovers) and may supply theinformation processing apparatus held by the user with the vibrationwaveform via the network.

A type of the “haptic feedback with respect to the object” correspondingto the electronic information is not limited. For example, by changing atemperature, a shape, hardness, or the like of the informationprocessing apparatus, it is also possible to present the hapticfeedback. For example, in response to the information about thetemperature, e.g., an air temperature, the temperature of theinformation processing apparatus may be controlled. Alternatively, inresponse to geographic features, geological features, or the like of auser's standing point, the shape or the hardness of the informationprocessing apparatus may be controlled.

The temperature can be controlled by using a heat source, e.g., aheater, included in the information processing apparatus, for example.Alternatively, it is also possible to control the temperature bycontrolling an action of a cooling mechanism including a fan device orthe like.

The shape of the information processing apparatus can be controlled byproviding a housing or the like of the control device with a shapememory alloy, a wire, or the like, for example. The hardness of thecontrol device can be controlled by controlling a support mechanismincluded inside, for example. Alternatively, a material that can controlthe hardness may be used.

Thus, the “haptic” feeling presented by the present technology includesnot only the haptic feedback but also the heat (temperature) felt fromthe object, the recognized shape, the hardness, or the like (it can bealso said that shape and hardness may be feeling based on the “hapticfeedback”). In other words, the “haptic feedback” according to thepresent technology includes a variety of feeling felt via contact. Also,illusionary feeling haptic feedback such as pseudo haptic feedback,virtual haptic feedback, illusive haptic feedback, and the like may beincluded.

In the above description, the information processing method according tothe present technology is executed by a computer, e.g., a mobileterminal, operated by the user. However, the information processingmethod and the program according to the present technology may beexecuted by using another computer communicable with the computeroperated by the user via the network, or the like. Also, the computeroperated by the user may be linked to other computer, to therebyconstructing the information processing system according to the presenttechnology.

In other words, the information processing method and the programaccording to the present technology can be executed not only by acomputer system including a single computer but also by a computersystem including a plurality of computers that are linked and operated.Note that, in the present disclosure, a system means a set of aplurality of components (device, module (parts), or the like) and it isnot a matter whether or not all components are present within the samehousing. Accordingly, both of a plurality of devices housed in separatedhousings and connected via a network and one device including aplurality of modules housed in one housing are systems.

The information processing method and the program according to thepresent technology are executed by the computer system. For example,both cases are included: acquiring the electronic information andoutputting a first haptic signal are executed by a single computer, andeach processing is executed by different computers. In addition,executing each processing by a predetermined computer includes executinga part or all of the processing by other computer and acquiring theresult.

Specifically, the information processing method and the programaccording to the present technology can be applied to a cloud computingconfiguration such that one function is shared and co-processed by aplurality of devices via a network.

The present technology may also have the following structures.

(1) An information processing apparatus, including: an informationacquisition unit that acquires electronic information; and

-   -   a signal output unit that outputs a first haptic signal for        presenting haptic feedback with respect to an object, the haptic        feedback with respect to the object being set corresponding to        the acquired electronic information.

(2) The information processing apparatus according to (1), in which

-   -   the haptic feedback with respect to the object includes haptic        feedback with respect to a container that contains the object        corresponding to the acquired electronic information.

(3) The information processing apparatus according to (2), in which

-   -   the electronic information includes a type of information and an        amount, and the haptic feedback with respect to the object        includes haptic feedback that appears when the container that        contains the object corresponding to the type of information of        an amount corresponding to the amount is moved.

(4) The information processing apparatus according to (3), furtherincluding:

a motion detector that detects a motion of the information processingapparatus, in which

-   -   the signal output unit outputs the first haptic signal for        presenting the haptic feedback that appears when the container        is moved on the basis of the detected motion of the information        processing apparatus.

(5) The information processing apparatus according to (3) or (4), inwhich

-   -   the electronic information includes a remaining battery charge,        and    -   the haptic feedback with respect to the object includes haptic        feedback that appears when the container that contains liquid of        an amount corresponding to the remaining battery charge is        moved.

(6) The information processing apparatus according to any one of (3) to(5), in which

-   -   the electronic information includes an electronic money balance,        and    -   the haptic feedback with respect to the object includes haptic        feedback that appears when the container that contains coins of        an amount corresponding to the electronic money balance is        moved.

(7) The information processing apparatus according to any one of (1) to(6), in which

-   -   the signal output unit outputs, as the first haptic information,        a drive signal for driving a haptic feedback presentation unit        that presents the haptic feedback with respect to the object by        a vibration.

(8) The information processing apparatus according to any one of (1) to(7), further including:

-   -   a motion detector that detects a motion of the information        processing apparatus, in which    -   the information acquisition unit acquires the electronic        information in a case where a predetermined motion of the        information processing apparatus is detected.

(9) The information processing apparatus according to (8), furtherincluding:

-   -   an information selection unit that selects a type of the        electronic information acquired by the information acquisition        unit on the basis of the detected motion of the information        processing apparatus.

(10) The information processing apparatus according to (9), in which

-   -   the signal output unit outputs a second haptic signal for        presenting haptic feedback corresponding to the type of the        electronic information selected by the information selection        unit.

REFERENCE SIGNS LIST

1 information processing apparatus

30, 40 container

11 controller

14 sensor unit

16 memory unit

17 vibration generator

31 liquid

41 coins

101 motion detector

102 information selection unit

103 information acquisition unit

104 waveform determination unit

105 signal supply unit

1. An information processing apparatus, comprising: an informationacquisition unit that acquires electronic information; and a signaloutput unit that outputs a first haptic signal for presenting hapticfeedback with respect to an object, the haptic feedback with respect tothe object being set corresponding to the acquired electronicinformation.
 2. The information processing apparatus according to claim1, wherein the haptic feedback with respect to the object includeshaptic feedback with respect to a container that contains the objectcorresponding to the acquired electronic information.
 3. The informationprocessing apparatus according to claim 2, wherein the electronicinformation includes a type of information and an amount, and the hapticfeedback with respect to the object includes haptic feedback thatappears when the container that contains the object corresponding to thetype of information of an amount corresponding to the amount is moved.4. The information processing apparatus according to claim 3, furthercomprising: a motion detector that detects a motion of the informationprocessing apparatus, wherein the signal output unit outputs the firsthaptic signal for presenting the haptic feedback that appears when thecontainer is moved on a basis of the detected motion of the informationprocessing apparatus.
 5. The information processing apparatus accordingto claim 3, wherein the electronic information includes a remainingbattery charge, and the haptic feedback with respect to the objectincludes haptic feedback that appears when the container that containsliquid of an amount corresponding to the remaining battery charge ismoved.
 6. The information processing apparatus according to claim 3,wherein the electronic information includes an electronic money balance,and the haptic feedback with respect to the object includes hapticfeedback that appears when the container that contains coins of anamount corresponding to the electronic money balance is moved.
 7. Theinformation processing apparatus according to claim 1, wherein thesignal output unit outputs, as the first haptic information, a drivesignal for driving a haptic feedback presentation unit that presents thehaptic feedback with respect to the object by a vibration.
 8. Theinformation processing apparatus according to claim 1, furthercomprising: a motion detector that detects a motion of the informationprocessing apparatus, wherein the information acquisition unit acquiresthe electronic information in a case where a predetermined motion of theinformation processing apparatus is detected.
 9. The informationprocessing apparatus according to claim 8, further comprising: aninformation selection unit that selects a type of the electronicinformation acquired by the information acquisition unit on a basis ofthe detected motion of the information processing apparatus.
 10. Theinformation processing apparatus according to claim 9, wherein thesignal output unit outputs a second haptic signal for presenting hapticfeedback corresponding to the type of the electronic informationselected by the information selection unit.
 11. An informationprocessing method executed by a computer system, comprising: acquiringelectronic information; and outputting a first haptic signal forpresenting haptic feedback with respect to an object, the hapticfeedback with respect to the object being set corresponding to theacquired electronic information.
 12. A program causing the computersystem to execute steps of: acquiring electronic information; andoutputting a first haptic signal for presenting haptic feedback withrespect to an object, the haptic feedback with respect to the objectbeing set corresponding to the acquired electronic information.
 13. Aninformation processing system, comprising: a first informationprocessing apparatus that acquires electronic information; and a secondinformation processing apparatus that is capable of communicating withthe first information processing apparatus and outputs a first hapticsignal for presenting haptic feedback with respect to an object, thehaptic feedback with respect to the object being set corresponding tothe electronic information acquired by the first information processingapparatus.